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A study evaluated the Early Literacy program that 
served 2,280 underachieving pupils in grades 1 and 2 in the Coluu.bus 
Ohio, public schools. These students appeared unlikely to learn to 
read successfully without additional reading instruction. The program 
featured small group instruction for these pupils each day for 40-45 
minutes on reading and writing activities. A major part of ths 
evaluation effort was accomplished through the administration^of the 
Metropolitan Achievement Tests. Results indicated that: (1) of a 
treatment group of 1,547 pupils, 1,117 (72.2%) displayed over time 
each of 3 strategic processing behaviors (constructing meaning, 
monit-ring reading, and integrating sources of information); (2) of 
the 1,506 treatment group pupils with available retention data, 1,366 
(90.7V.) were promoted; (3) 810 (67.87.) grade 1 pupils read 5 or more 
books at level 8 or above and 201 (817.) grade 2 pupils independently 
read at least 10 books; (4) normal curve equivalent (NCE) gains in 
Total Reading for grade 2 pupils was 3.22 NCEs , with discontinued 
pupils having an average gain of 8.34 NCEs and not discontinued 
pupils having an average gain of 1.25 NCEs; and (5) 1,956 different 
parents or guardians were involved in the program, and 3,804 contacts 
were made by these individuals. Findings suggest continuation of the 
program with consideration given to 5 areas of concern. (Contains 8 
tables of data. Appendixes present the Concepts about Prxnl scoring 
sheet, a matrix of data, teacher census form, a calendar 
worksheet/parent involvement log, evidence.) (RS) 
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RNAL EVALUATION REPORT 
EARLY LITERACY PROGRAM 
GRADES 1 AND 2 
1993-94 

ABSTRACT 



Prgqram Description: The Early Literacy program seived 2280 pupils in grades 1 (1 796) and 2 (484) Funding for the 
program was provided through a combination of sources: Elementaty and Secondary Education (ESEA) - Chapter 1 
Disadvantaged Pupil Program Fund (DPPF). and Columbus Public Schools' general fund monies. The purposTof the" 
Earty Literacy program was to provide earty inten/ention to underachieving first- and second-grade pupils who 
appeared unlikely to leam to read successfully without additional reading instruction. The program featured small 
group instruction for first- or second-grade pupils for 40^ minutes daily. During 1993-94. 71 teachers (46 20 PTEs - 
Full Time Equivalents) sen/od pupils in 56 schools. 

Time Intefval ; For evaluation purposes, the Eariy Literacy program began on Septenijer 20. 1993. For evaluation 
based on standardized test data, the time inten/al ended March 18. 1994. This provided a maximum of 105 possible 
days of instruction. An additional 29 scheduled days (through May 6. 1994) were included in the time interval for 
evaluation of desired outcomes not based on standardized test data (Desired Outcomes 1 2 and 3) providing a 
maximum of 134 possible days of instruction. To meet the attendance criterion (50%) for inclusion in the analyses of 
standardized test data grade 2 pupils must have attended at least 52.5 days. To meet the attendance criterion (50%) 
for^inclusion in the analyses of Desired Outconies 1. 2 and 3, grade 1 and 2 pupils must have attended at least 67.0 

As»£: The Eariy Literacy program teacher and each group of pupils worthed together each day on reading and 
writing actrvities. The lessons included reading to the pupils, guided reading of charts and stories, shared 
readingAwrrting actiyrties. independent readin^Avriting activities, and activities designed to help pupils attend more 
closely to print. The lessons were tailored to build on what the pupils already knew white strengthening a self 
inprovement system which woukJ lead to continued growth. •yinen.ng 

Aghievement QbiectiVft: Pupils were to receive Earty Literacy instruction until they were ready to be successfully 
decontinued from the program. Discontinued pupils were those who successfully conpleted the program according 
to (a) predetermined levels on diagnostic measures indicating that the pupils were reading at the average level for the 
detnct and (b) teachers judgments that the pupils had developed effective reading strategies and couW leam in the 
normal classroom setting without extra individual help. ■» u »a^uiu warn m ine 

Evaluation Design: Three desired outcomes were established for the Eariy Literacy program. Rrst at least 50 
percent of he pupils who attended the program at least 50 percent of the treatment peri(id or who were dtecontinued 
would deplay over time three strategy processing behaviors - constructs meaning, monitors reading, and integrates 
sources of information Second, at least 75 percent of the pupils who attended the program at teast 50 porceS the 
treatment penod or who were discontinued wouW be promoted to the next grade level. Third, at least S percent of 

read at least fn^e books at te)rt reading level 8 or above; and at least 50 percent of grade 2 pupils who attended the 
prograrn at least 50 percent of the treatment period and who were not dtecontinued wouW ind^ndently read atleit 
10 books In addition to the three desired outcomes, federal guidelines also required that aggregate test data be 
reported for pupils in grades 2 and above for indivklual buiWings for Total Reading and ReSing CorSehensioS 
(aggregate for buiWing must be greater than or equal to 2.0 NCE). Although not part of the evaluation dS parent 
involvement information was also collected by program teachers. >»vaiuaiion aesign. parent 

A.hiA^nt'r'! °«iTrfS''"/J'°^*^ *° ^ accomplished through the administratbn of the Metropolitan 
^dZT J ' 5). Adminfetered on a spring-spring test cycle, the test series sensed as the p/etest 

and posttest for grade 2 pupils. The spnng administration to grade 1 pupils sen/ed as the pretest for grade 2 
Analyses of the standardized test data included average NCE scores and pretest-posttest NCE gains fo grade 2 
Another major part of the evaluation effort was to be accorrplished through the collection of data, using a \o^Jy 
constructed instrurr^nts. on pupil reading processing behaviors and pupil independent reading. L^^rconstS 
instmments were ateo used to collect enrolimenVattendance and parent involvement data. DisWd c^lr Tes^i^ 
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Ma j or Rndings/Recommendations ; Data provided by program teachers irxlicated that the program served 2280 
pupils in 56 schools, including 1 796 grade 1 and 484 grade 2 pupils. Average daily mertijership for the program was 
1451 .07 pupils, with average days scheduled being 85.28 days and average days served being 74.75 days per pupil. 
The 2280 pupils sewed were classified as either discontinued (455). not discontinued but attended the program 50 
percent of the treatment period (1092). or other pupils served (733). The Ueatment group for Desired Outcome 1 
consisted of the 1547 pupils (67.9% of those sewed) who were successful;/ discontinued from the program or who 
attended the program at least 50 percent of the treatment period, including 1195 (66.5%) grade 1 pupils and 352 
(72.7%) grade 2 pupils. The treatment group for Desired Outcome 2 consisted of the 1506 pupils who were either 
successfully discontinued from the program or who attended the program at least 50 percent of the Ueatment period 
and had available promotion-retention data, including 1163 (64.8%) grade 1 pupils and 343 (70.9%) grade 2 pupils 
The treatment group for Desired Outcome 3 consisted of 1443 pupils, including 1195 (66.5%) grade 1 pupils who 
were either discontinued from the program or attended the program at least 50 percent of the treatment period and the 
248 (51.2%) grade 2 pupils who were not discontinued from the program and who attended the program at least 50 
percent of the treatment period. The evaluation sample for analyses of standardized test data consisted of the 266 
grade 2 pupils who were successfully discontinued from the program or who attended the program at least 50 percent 
of the treatment period, were English-speaking, and had valid pre- and posttest scores on the MAT6 in Total Reading. 
In addition. 282 grade 2 pupils who were successfully discontinued from the program or attended the program at least 
50 percent of the treatment period, were English-speaking, and had vaM pre- and posttest scores in Reading 
Comprehension, comprised the Reading Comprehenskjn evaluation sanple for grade 2. 

The three established desired outcomes were met for the program. Of the 1547 treatment group pupils, 1117 
(72.2%) achieved Desired Outcome 1. displaying over time each of the strategic processing behavwrs. including 
constructing meaning, monitoring reading, and integrating sources of infonnation (criterion was 50 0%) These 1117 
pupils included 828 (69.3%) grade 1 pupils and 289 (82.1%) grade 2 pupils. Of the 1506 treatment group pupils with 
available retention data. 1366 (90.7%) were promoted, achieving Desired Outcome 2 (criterion was 75 0%). By grade 
level. 1051 (90.4%) grade 1 pupils and 315 (91.8%) grade 2 pupils were promoted to the next grade level. Desired 
Outcome 3 was met. with data indicating that 810 (67.8%) grade 1 pupils read five or more books at level 8 or above 
and 201 (81 .0%) grade 2 pupils independently read at least 10 books (criterion was 50.0%). 

Results of standardized testing indicated that the average Normal Cuwe Equivalent (NCE) gain in Total Reading 
for grade 2 pupils (266) was 3.22 NCEs. with discontinued pupils (74) having an average gain of 8 34 NCEs and not 
discontinued pupils (192) having an average gain of 1.25 NCEs. In Reading Conprehension. grade 2 pupils (282) 
had an average NCE gain of 7.51 NCEs. with discontinued pupils (79) gaining 11.46 NCEs and not discontinued 
pupils (203) having a gain of 5.98 NCEs. 

Changes in NCE scores for Total Reading for the 266 grade 2 evaluation sanple pupils indicated that 146 pupils 
(54.9%) had an NCE gain of 2.0 or more and that 139 pupils (52.3%) had an NCE gain of 3.0 or more. Discontinued 
pupils showed greater improvement than did not discontinued pupils, with 64.9% (48) gaining more than 3 0 NCEs 
compared to 47.4% (91) for not discontinued pupils. Changes in NCE scores for Reading Conprehenswn for the 282 
grade 2 evaluation sample pupils showed that 183 pupils (64.9%) had an NCE gain of 2.0 or more and that 175 pupils 
(62.1%) had an NCE gam of 3.0 or more. Discontinued pupils showed greater inprovement than dW not discontinued 
pupils, with 68.4% (54) gaining more than 3.0 NCEs. compared to 59.6% (121) for not discontinued pupils. 

Parent involvement information showed 'Jiat 1956 different parents or guardians were involved in the program 
and that 3804 contacts were made by these indivWuals. The 1547 treatment group pupils represented 77 6% (1518) 
of the total number of different parents or guardians involved in the program and 81.2% (3088) of the total contacts 
n^de. 

It is recommended that the Eariy Literacy program be continued for the 1 994-95 school year, with consWeration 
gwen to: (1) examining the process for discontinuing pupils; (2) increasing parent invoh/ement; (3) provWing 
opportunities for co-ordination between the program and classroom teachers; (4) establishing a structured process 
obsewation procedure; and (5) maintaining a viable inservice program for program teachers 
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Final Evaluation Report 
Early Literacy program 
Grades 1 and 2 



1993-94 



Program Description 



The purpose of the 1993-1994 Eariy Literacy program was to provide eariy intervention to 
underachieving first- and second-grade pupils who appeared unlikely to team to read successfully without 
additional reading instruction to supplen>ent their regular classroom reading instruction. To acconplish this 
purpose the program featured small group instmction for first or second grade pupils for 40-45 minutes daily 
provided by an Eariy Literacy program teacher. The group instruction was designed to provide a more 
comprehensive assessment of a pupil's development of reading and writing strategies than might be 
achieved during regular classroom instmction. Many of the activities developed during Early Literacy 
instruction were based on activities established in the Reading Recovery™ program, a program of intensive 
one-on-one instruction for underachieving at-risk first-grade pupils. 

The Eariy Literacy program was initiated in Columbus Public Schools during the 1990-1991 school 
year, serving 1477 pupils (817 grade 1 and 660 grade 2 pupils) at 43 schools, with a teaching staff of 65 
teachers (20.52 FTEs-Full Time Equivalents). During the 1991-92 school year, the number of pupils 
served increased to 1773 (1 185 grade 1 and 588 grade 2 pupils) with a teaching staff of 54 teachers (37.50 
PTEs). For 1992-93. the number of pupils served increased again, with 2278 being sen/ed (1655 grade 1 
and 623 grade 2). and a teaching staff of 69 teachers (50.50 PTEs). During 1993-94. 2280 pupils were 
served (1796 grade 1 and 484 grade 2 pupils), with a teaching staff of 71 teachers (46.2 PTEs). The 
majority of program teachers taught in both the Earty Literacy and Reading Recovery programs, sen/ing 
three or four groups of Eariy Literacy pupils and two or three individual Reading Recovery pupils daily, 
while other program teachers sen/ed only Eariy Literacy pupils, six or seven groups per day. Four teachers 
were half-time emptoyees of the school system, serving three groups each day. 

In 1993-94 tha Eariy Literacy program was kxated in the following 56 elementary schools. Thirty- 
seven schools served only grade 1 pupils, one school served only grade 2 pupils, and 18 schools served 
both grade 1 and 2 pupils. 



Schools and Grade Levels Served by the Eariy Literacy Program 

1993-94 



Ariington Park (1 ) Easthaven (1 ) Kenwood (2) 

Avondale (1 & 2) Fair (1 & 2) Koebel (1 ) 

Beck (1 ) Fainroor (1 & 2) Leawood (1 ) 

Binns (1 ) Fainwood (1 ) Lincoln Park (1 ) 

Broadleigh (1 ) Rfth (1 ) Linden (1 & 2) 

Bunoughs (1 & 2) Franklinton (1 & 2) Linden Park (1 ) 

Cassady (1 ) Gladstone (2) Livingston (1 & 2) 

Clarfiekl(l) Hamilton (1) Main(1) 

Como (1 & 2) Hey! (1 & 2) Maize (1) 

Dana (1 & 2) Highland (1 ) McGuffey (1 & 2) 

Deshler (1 & 2) Hubbard (1 ) Medary (1 ) 

Eakin(l) Huy(1) North Linden (1) 

East Columbijs (1 & 2) Innis (1 ) Ohio (1 ) 

East Linden (1 & 2) Kent (1) Pilgrim (1) 



Reeb(1) 
Salem (1) 
Scottwood(l) 
Second (1) 
Siebert(l) 
South Mifflin(l) 
Southwood (1 & 2) 
Sullivant (1) 
Trevitl (1 & 2) 
Weinland Part<(1) 
West Broad (1 & 2) 
West Mound (1) 
Westgate (1) 
Windsor (1 & 2) 



Note; Nuniber(s) within parentheses refers to grade level(s) served. 
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Schools were chosen for inclusion in the program according to the percent of pupils attending a school 
who were eligible for a free or reduced price kinch (F or RPL). Those schools with the highest percentage 
of F or RPL were included in the program for the year. Fifty-four of the 56 schools were selected in this 
manner. Two schools were chosen because they did not receive any other type of compensatory 
education service for the school year (Gladstone end Kenwood Elementaries). The Early Literacy program 
was funded by a combination of Elementary and Secondary Education Act (ESEA) Chapter 1, Ohio 
Disadvantaged Pupil Program Fund (DPPF), and Columbus Public Schools' general fund nxxiies. 

The 71 program teachers received support from five program coordinators who provided inservice 
training and instructional support. Because many of the instructional and assessment strategies used in 
the Early Literacy program were similar to those used in the Reading Recovery program, the Early Literacy 
instructional program was enhanced by the fact that all five program coordinators and 68 of the 71 program 
teachers were trained in Reading Recovery techniques. 

At the beginning of the year grade 1 pupils identified as underachieving by their classroom teachers 
and the Early Literacy program teachers were given two selection tests. Concepts About Print and Dictalioa 
(see Appendix A, pp. 18-19), which are two of the diagnostic assessments used in the Reading Recovery 
program developed by Marie Clay (1979). Raw scores from these two tests were used to detemnine a 
Selection Score for each pupil. To be eligible for service, pupils must have had a Selection Score on the 
Grade 1 Observational Tests Scoring Matrix less than 78 (see Appendix B, p. 21), those with the lowest 
scores being served first. Other grade 1 pupils with Selection Scores below 78 were selected for the 
Reading Recovery program. A waiting list was formed for those pupils not receiving immediate service in 
either program. Grade 1 pupils being served in the Early Lrteracy program were eligible for service in the 
Reading Recovery program if a space became available, but they could not be sen/ed in both programs 
simultaneously. 

Grade 2 pupil eligibility for program sen/ice was based on a Service Index Number. A Service Index 
Number indicates the degree to which a pupil is achieving relative to the pupil's age and appropriate grade 
level. Grade 2 pupils' Service Index Numbers were detennined by their age, grade level, and the test score 
they received on the previous year's spring standardized test administration (Metropolitan Achievement 
Tests, 1985, Level Primer, Fomn L) from a regression equation. Those pupils with the lowest Service Index 
Numbers were served first. Those pupils without spring standardized test scores who might qualify for 
service were given a selection test to determine their Service Index Number. If their Service Index Number 
was below 43.0, they were ranked in order with the other second-grade pupils whose numbers were below 
43.0. A waiting list was fonned for those pupils not receiving immediate service. Selection procedures 
followed guidelines established by Federal and State Programs. 

The Early Lrteracy program teacher and a group of five or six pupils worked together each day on 
reading and writing activrties. The lessons included reading to the pupils, guided reading of charts and 
stories, shared reading/writing activities, independent reading/writing activrties, and activities designed to 
help pupils attend more ctosely to print. The reading and writing lessons were tailored to build on what the 
pupils already knew while strengthening a self improvement system which woukl lead to continued growth. 

Pupil progress was nxjnitored by both the Early Lrteracy program teacher and the pupil's regular 
classroom teacher. If in consultation they felt that a particular pupil had made satisfactory progress and no 
tonger needed the servwes of the Earty Lrteracy teacher, established procedures were folkAved for 
successfully discontinuing the pupil from the program. The process for discontinuing a grade 1 Eariy 
Lrteracy pupil consisted of the following steps: 

[1] The program teacher sent the last five running records (records of exactly what the pupil said and 
dkJ while reading a story) to a program coordinator for examination. 

(2] If the program coordinator determined that the pupil had made satisfactory progress, she notified 
the program teacher's testing partner (program teachers do not test their own pupils) and 
arrangements were made for the pupil to be tested for discontinuance. 
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[3] The pupil was administered three observational survey tests: Writing Vocabulary. Dictation Te^t. 
and Text Reading Level developed by Marie Clay as part of the Reading Recovery program. Also, 
for text reading assessment, a running record was tal<en while the pupil read an unfamiliar story. 

(4] Results of the testing and running record were given to the program coordinator to make the final 
determination for discontinuing the pupil. 

[5] The program teacher infomned the regular classroom teacher that the pupil had been successfully 
discontinued and would no longer receive program service. If the pupil was not successfully 
discontinued, the program teacher would continue to work with the pupil, emphasizing areas of 
weakness, until discontinuance testing was administered again. 

To be successfully discontinued, a grade 2 pupil must have met four criteria: 

[1] The pupil must have been able to leam successfully through regular group instmctton in the 
classroom as derrwnstrated by receiving satisfactory grades (S) on his/her report card in language 
arts. 

[2] The pupil must have been able to read successfully in the on-grade level text or above-grade level 
materials used in the classroom. 

[3] The pupil must have been able to independently produce daily writings satisfactorily for his/her 
grade placement. 

[4] The pupil must have been able to achieve a minimum score of 80% of the total items on at least 
two consecutive fomative unit tests and a rubric score of three or four on at least one open-^nded 
question on each of the two formative tests, or the pupil must have read a designated second 
grade reading passage at 90% accuracy level and correctly completed a mininrxjm of 3 of 5 Hems 
on an objective item test that conresponds to the testing passage and achieved a rubric score of 3 
or 4 on the open-ended questton for that passage. 

A grade 2 pupil who was discontinued retumed to total instructton by the regular classroom teacher 
and was nx)nitored by the Eariy Literacy teacher for progress in reading, tf a discontinued pupil failed to 
maintain satisfactory classroom progress, the pupil was re-enrolled in the Eariy Lrteracy program, tf an 
opening was not available, the pupiPs name was placed at the top of the waiting list because of previous 
servfce, regardless of servfce index ranking. 

Evaluation Design 

For program year 1993-94. evaluation of the Eariy Literacy program included three desired outcomes. 
Data collected in four major areas were incorporated in the analyses of the desired outcomes: pupil census 
infonnatton. pupil strategy processing behavwr informatton, pupil relainee infomiation, and pupil 
independent reading achievement infonnatKMi. Pupil standardized achievement test infonnatton was also 
collected. Although not part of the evaluatton design, parent involvement infomiatton was collected by 
program teachers. 

Desired Dirtmme 1 

At least 50 percent of the pupils who attended the program at least 50 percent of the treatment period 
or who were discontinued will display evWence to the satisfactton of the prrtgram teacher of each 
strategic processing behavtor at least once during the instmcttonal period when reading appropriate 
text. 
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Desired Outcome 2 

At least 75 percent of the pupils who attended the program at least 50 percent of the treatnient period 
or who were discontinued will demonstrate satisfactory progress in the ■'egular classroom as 
demonstrated by promotion to the next grade level. 

Desired Outcome 3 

Of the grade 1 pupils who were discontinued or have attended the program at least 50 percent of the 
treatment period, at least 50 percent of the pupils will read at least five books at text reading level 8 or 
above as certified by the program teacher. At least 50 percent of the pupils in grade 2 who have 
attended the program at least 50 percent of the treatment period and were not discontinued will 
independently read throughout the treatment period a minimum of ten books as certified by the 
program teacher. 

Standardized test data for Total Reading and Reading Comprehension are reported for grade 2. 
Federal guidelines require that aggregate test data (reading and mathematics) be reported for grades 2 and 
above Ua individual buildings for Total Reading and Reading Comprehenskxi. For this reason. Total 
Readirig and Reading Ck)mprehensk>n test data are incorporated in the results of pupil standardized 
achievement test infomiatfon (p. 10) in this report for grade 2. For grade 1. pretesting dkf not occur, but 
posttesting dkJ. Therefore, no Total Reading or Reading Comprehenswn pretest-posttest change scores 
could be detemiined for grade 1 pupils. 

Eariy Literacy program instmctton for grades 1 and 2 began on September 20. 1993. For evalualwn 
based on standardized test data, which included aggregate test infomiatton, the time interval ended March 
18, 1994. Tills provkJed a maximum of 105 days of instmction for grade 2. An addittonal 29 scheduled 
days (through May 6. 1994) were included in the time interval for evaluaton of the desired outcomes whwh 
were not based on standardized test data. provWing a maximum of 134 possible days of instmction. To 
meet the attendance cfTteik>n (50%) for inclusion in the analyses of standardized test data, grade 2 pupils 
must have attended at least 52.5 days. To meet the attendance criterron (50%) for incluswn in the 
analyses of the desired outcomes, grade 1 and 2 pupils must have attended at least 67.0 days. 

Instruments 

The evaluatwn design provWed for the collectfon of data in the foitowing six areas of operatwn for the 
overall program. Included in the coIIectk>n of data was parent involvement informaton. whteh was not part 
of the evaluation design. 

1 . Teacher Census Infonnatton 

Teacher Census Form (TCF) was completed by program teachers to obtain staffing infonnatfon. 
including employment status, periods of program instmction. and school assignment (see 
Appendix C, p. 23). 

2. Pupil Census Infonnatkjn 

Calendar Worksheet/Parent Involvement log (CW/PIL) was used to record pupil servwe 
infomfiaton. Selecton Scores/Service Index Numbers, and parent involvement data (see 
Appendix D. pp. 25-27). 

Pupil Roster.was completed by program teachers to indicate offteial enrollment of each pupil into 
the program. Program teachers Certified pupils served from computer generated lists of all first 
or second grade pupils in their buiWings. Infomiatfon included pupil nanr>e, student nuntier. date 
of birth, program teacher name, school code, and program code. 

Pupil Data Sheet (PDS) was a computer generated preprinted fomi used by program teachers to 
summarize enrollment/attendance data, reading strategy processing behavtors, independent 
reading achievement informatk)n, parent involvement, discontinued status, hours of instmcton 
per week, English-speaking status, and progress made for each pupil sensed (see Appendix G 
pp. 33-34). 
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3. Pupil Reading Strategic Ptxx^essing Behavior Infom^tion 

Evidence of Strategic Processing Collection Form was used by program teachers throughout the 
year to record student behaviors which display strategic processing (see Appendix E, p. 29). 

Pupil Data Sheet (PDS). described earlier, was a computer generated pr^sprinted form used by 
program teachers to summarize reading strategic processing behavior infonnation for each pupil 
served (see Appendix G, pp. 33-34). 

4. Retention Information 

District computer files were utilized to access retention data. 

5. Pupil Independent Reading Achievement/Pupil Standardized Achievement Test Information 

Independent Reading Record Sheet was used by program teachers throughout the year to record 
the successful reading experiences of program pupils (see Appendix F, p. 31 ). 

Pupil D ata Sheet (PDS). described eariier, was a computer generated preprinted fomi used by 
program teachers to summarize independent reading achievement information for each pupil 
served (see Appendix G, pp. 33-34). 

The Metropolitan Achievement Tests (MATS. 1985), administered on a sprir^-spring test cycle, 
served as the pretest and posttest for grade 2 pupils. The spring administration to grade 1 pupils 
served as the pretest for grade 2. The MAT6 tests were also used to generate the Service Index 
Number. This test series has empirical norms for fall and spring, established October 1-31 , 1984, 
and April 8 to May 1 5, 1 985. The description of the MAT6 pretest and posttest is as foiJcws: 



Recommended Number 

Lsv&L Fomn Grade Range Subl&SlS. oLtlems. 

Posttest Primer L K.5-1.9 Vocabulary 15 

(Grade 1) Word Recognition Skills 36 

Pretest Reading Comprehension 3a 

(Grade 2) Total Reading 89 

Posttest Primary 1 L 1 .5 - 2.9 Vocabulary 22 

(Grade 2) Word Recognition Skills 28 

Reading Comprehension 52 
Total Reading 103 



The MATS tests were administered by classroom and program teachers. Pretest-posttest change 
scores are based on the spring-spring test cycle. Posttesting for 1994 occun-ed March 21-24, 
1994. All testing was done on level, as indicated in the table above. 



6. Parent Involvement Information 

Parent Involvement Log (PIL) was used to record parent involvement data, including the date, 
type of activity/involvement, and name of attendee(s) (see Appendix D, p. 27). 

Pupil Data Sheet (PDS), described eariier, was a computer generated preprinted fonn used by 
program teachers to summarize data collected from the Parent Involvement Logs for each pupil 
served (see Appendix G, pp. 33-34). 



Inservice evaluatfon informatfon, data which were not specified in the Eariy Literacy evaluation design 
but were collected routinely, is not included here but reports have been submitted to the Department of 
Federal and State Programs and are available upon request. 



ERIC 



Q P:\P519\nEVEL94 

6-15-95 8:51AM <j 



6 



Major Rndings 

PuDil Censu s Information 

During the 1993-94 school year, a total ol 2280 pupils were served by the Early Literacy program. Of 
this number. 1796 grade 1 pupils were served and 484 grade 2 pupils were served. The demographic 
characteristics (gender, race, and socio-economic status) of the 2280 pupils who were served in the 
program were analyzed from the school district's Student Master Rle (SMF) using the June 1994 official 
enrollment tape. The data were based on information reported by parents and/or school personnel. Of the 
pupils served, 55.1% (1257) were boys and 44.9% (1023) were giris (see Table 1). As for the distnlxition 
by race, 42.9% (978) of the pupils served were identified as Non-Minority, 54.6% (1244) were Black, and 
the remaining 2.5% (58) were Other Minority (see Table 2). The Other Minority category included Spanish 
Surname, Asian American, and American Indian. Socio-economic status was indicated by pupil eligibility 
for subsidized (free or reduced price) lunch as of June 1994. Of the 2280 pupils served, 83.8% (1911) 
were on free lunch, 3.8% (86) were on reduced price lunch, and 12.4% (283) were not on subsidized lunch 
(see Table 3). Distributions of gender, race, and socio-economic status by grade level are displayed in 
Tables 1-3. 

The average number of hours of instmction in the Eariy Literacy program per pupil per week was 3.8 
hours. The average daily membership for the program was 1451 .07 pupils, with average days scheduled 
(enrollment; being 85.28 days per pupil, and average days served (attendance) being 74.75 days per pupil. 
Enrollmerrit and attendance data are used to determine whether a pupil will be included in the treatment 
group for program analyses. To be included in the analyses of standardized test data, grade 2 pupils nxist 
have been discontinued or attended the program 52.5 days, had valid pre- and posttest scores, and have 
been English-speaking. Grade 1 pupils needed to be discontinued or to have attended a mininxim of 67.0 
days to be included in the analyses for Desired Outcomes 1 , 2 and 3. Grade 2 pupils also needed to be 
discc/ntinued or to have attended a minimum of 67.0' days to be included in the analyses for Desired 
Outcomes 1 and 2, but the treatment group for Desired Outcome 3 for grade 2 included those pupils who 
attefxJed a minimum of 67.0 days but were not discontinued. Data pertaining to enrollment and attendance 
are presented in Table 4. Of the 2280 pupils served, 455 (20.0%) were successfully discontinued from the 
p}i^.)gram. These 455 discontinued pupils represented 29.4% of the 1547 Desired Outcome 1 treatment 
g'xxjp pupils. By grade level, 351 (1 9.5%) of the 1 796 grade 1 pupils were successfully discontinued, while 
104 (21 .5%) of the 484 grade 2 pupils were successfully discontinued (see Table 5). 

Pupil census informatkxi was also obtained from program teachers (Pupil Data Sheet, Appendix G, 
pp. 33-34) concerning whether or not pupils were English-speaking and, from the Student Master Rle, 
whether or not pupils qualified for a special education program. Of the 2280 pupils served. 44 (1 .9%) 
qualified for a special education program. Concerning pupils' English-speaking ability, only 17 (0.7%) of the 
2280 pupils sen/ed were norvEnglish speaking. 

To be included in the Eariy Literacy treatment group for Desired Outcome 1 , grade 1 and 2 pupils must 
have been successfully discontinued from *he program or attended the program at least 50 percent of the 
treatment petiod. Of the 2280 pupils served, 67.9% (1547) met the established criteria and were included 
in the treatment group, including 455 discontinued pupils and 1 092 not discontinued pupils who met the 50 
percent attendance criterion (see Table 5). By grade level, 66.5% (1 195) of grade 1 pupils were included in 
the treatment group and 72.7% (352) of grade 2 pupils were included. To be included in the treatment 
group for Desired Outconr)e 2, the treatment group pupils from Desired Outcome 1 nxist also have had 
available promotion-retention data. Of these 1547 treatment group pupils, 1506 had available promotion- 
retention data, including 1 1 63 (64.8%) grade 1 pupils and 343 (70.9%) grade 2 pupils. The treatment group 
for Desired Outcome 3 included the same 1 195 grade 1 pupils as in Desired Outcome 1 . Desired Outcome 
3 grade 2 pupils included the 248 pupils who were not discontinued from the program and who attended 
the program at least 50 percent of the treatment period. These 248 pupils were 51 .2% of the 484 grade 2 
pupils sen/ed. 
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Table 4 



g 



Number of Pupils Served, Averages for Days Scheduled, 
Days Served, Daily Membership, and Hours of Instruction Per Week 
for Early Literacy Program 
Reported by Grade Level 
1993-94 



Average 

rr.Ha o^"^!!. oPl^^ Hourcoflnstoiction 

G-rade Served Scheduled Served Membership per Pupil per Week 



1 1796 84.85 74.33 1137.22 3.8 

2 484 86.89 76.32 313.85 3.8 

Total 2280 85.28 74.75 1451.07 3.8 



Table 5 

Percent and Number of Early Literacy Pupils 
Served by Pupil Category and Grade Level 
1993-94 



Grade Level 



Pupil Category 



Discontinued 
Pupils^ 



Not 
Discontinued 
Pupils^ 



Other 
Pupils 

Served^ 



Total 
Pupils 
Served 





% 


a 


% 


a 


% 


n 


% 


R 


Grade 1 


19.5 


(351) 


47.0 


(844) 


33.5 


(601) 


78.8 


(1796) 


Grade 2 


21.5 


(104) 


51.2 


(248) 


27.3 


(132) 


21.2 


(484) 


Total 


20.0 


(455) 


47.9 


(1092) 


32.1 


(733) 


100.0 


(2280) 



3 Discontinued pupils did not have to meet attendance criteria 

^ Not di.«;continued pupils with 50% program attendance 

c aher pupils served with less than 50% program attendance 
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The two evaluation samples for analyses of standardized test data were comprised of grade 2 dudIIs 
froni the Desired Outcome 1 treatment group who also were English-speaking and had valid pre^^and 
posttest scores on the MAT6. The Total Reading evaluation sample included 266 pupils, which was 55 0% 
of the 484 grade 2 pupils served in the program The Reading Comprehension evaluation sample was 

"^TSTof u J'^"^^} ^"'^ ^^"^ P""®- scores. The evaluation sanple pupi^ made 

up 58.3% of the 484 grade 2 pupils served in the Early Literacy program. 

PuDil Strateoic Processinc? Behavior Infnnn fl ti o n 

Desired Outcome 1 stated that at least 50 percent of the pupils who attended the program at least 50 
percent of the treatment period or who were discontinued would display evidence to the satisfaction of the 
program teacher of each strategic processing behavior (monitors reading, constmcts meanina and 
?31S' oo'on°"'^t' °* '"'o?^*'^^") a< 'east once during the treatment period when reading appropriate text 
Of the 2280 pupils served in the program. 1547 (67.9%) met one of the criterion and were included in the 
treatment group. Oi the 1547 pupils. 1117 (72.2%) displayed over time the appropriate behaviol? 
indicating that the 50% criterion for this desired outcome was met. By grade level 828 (69 3%) orade 1 
pupils and 289 (82. 1 %) grade 2 pupils displayed the appropriate behaviors to achieve the desired outcome. 

PuDil Retainee Infnrmatinn 

Desired Outcome 2 stated that at least 50 percent of the pupils who attended the program at least 50 
percent of the treatment period or who were discontinued would demonstrate satisfactory progress in the 
classroom by being promoted to the next grade level. Pupils who met the attendance criteria or were 
Sn^rnr^f ?H T'!? *'?i;^e^^'^e"^ 9^°"P- Data analyzed from the district June 1994 official enrollment 
/I 2fL "1 "^^.^n^ outcome was met. Of the 1547 pupils in the Eariy Literacy treatment group. 
wtero^.^?o fhl°' T^'a ^ P"P"'' ^366 (90.7O/O) made satisfairy progress arS 

Z7^bZ^/^1hT ^'^^'H:''' 1051 (90.40/0) grade 1 pupils were promot^ to grade 2 

and 31 5 (9 1.8%) grade 2 pupils were promoted to grade 3. 

Pupil Independent Rpadi no Informatinn 

=H«nS-S';f ^""^"^""^ ^ ^ ''^'^ ^^^^ '®^s^ 5° percent of the pupils who were discontinued or 

attended the program at least 50 percent of the treatment period would read at least five books at te^ 
reading level 8 or above as certified by the program teacher. Of the 1796 grade 1 pupils served in the 
^'TVnf.lt^^'''''^ T °' ^«^e the trelent grS^p a thel 1195 

tSde^rSS^alLr ''''' ' °^ ^'^^ theloo/criterinTvi/f^r 

at iJJin^ Outcome 3 for grade 2 stated that at least 50 percent of the pupils who attended the program 
the tSltmPnf n.!l^^ ''"^^ ""S^.""^ discontinued woukJ independently read thrSX! 

1. T T ^ ^ """'"^"^ °* "^"^^''^ P">9ra"i teacher. Of the 484 grade 2 pS 
served in he program. 248 (51.2%) met both criteria for inclusion in the treatment group a thesr258 

5of.l 7.' 'J '"'fi^'" "^'^ '° '''' °* program teachSicaSr^ thatIS 

50% cntenon level for this desired outcome was met. 

PuDil Standardized ArhiA wment Tftyt lnfnrtT|f ,tj^n 

Tabte/fa,lr7'"?Io''''"^V'°'^ 2 ^"^^ Literacy program pupils are summarized in 

tmS inH^- equivalent (NCE) is used in Tables 6 and 7 because it provides the 

truest indicatK>n of pupil growth in achievement. It should be noted that NCEs like percentHe ranks 
corripare the pupils' perfom^nces in relation to the general populatSi. No cha^e in NCE sSre from 
sSvL^hf tn' ''""''J '^'^ ''''''''' P'^^^^^" the contrTry.TrT;2ans fhat olThe 
SSn^ in tS^^ ^"^'"''.'^ "'^'^^ °* O^^'^ "^'"tained the same relatle 

position in temis of the general populatton. Therefore, eve;, a small gain in NCEs indicates an 

advancement from the pupirs original position relative to the general population 
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Table 6 contains a summary of pretest, posttest, and change scores for Total Reading for the 266 
Early Literacy Total Reading evaluation sample pupils in grade 2. The data in Table 6 show the total 
average growth in Total Reading for pupils was greater thsn expected. While the expected NCE change 
for the normal school population is zero NCE points during the course of a school year, the total average 
change for Early Literacy pupils was 3.22 NCE points. Discontinued pupils showed much greater gains in 
Total Reading than did not discontinued pupils. The 74 discontinued pupils with valid pre- and posttest 
scores showed a gain of 8.34 NCEs, while the 192 not discontinued pupils had an average gain of 1.25 
NCEs. 

Table 6 also contains pretest, posttest, and change scores in Reading Comprehension for grade 2 
pupils. For the 282 pupils in the Eariy Literacy Reading Comprehension evaluation sample, the data 
indicate the average growth for grade 2 pupils was greater than expected. Grade 2 pupils showed a gain of 
7.51 NCEs in Reading Comprehension. Discontinued pupils (79) had an average gain of 1 1 .46 NCEs, and 
not discontinued pupils (203) showed a comparable gain of 5.98 NCEs. 

Table 7 contains a summary of data related to the changes in NCE scores for Total Reading and 
Reading Comprehension. Changes in I'JCE scores for Total Reading for the 266 grade 2 evaluation 
sample pupils indicated that 146 pupils (54.9%) had an NCE gain of 2.0 or more and that 139 pupils 
(52.3%) had an NCE gain of 3.0 or more. Discontinued pupils showed greater improvement than did not 
discontinued pupils, with 64.9% (48) gaining more than 3.0 NCEs, compared to 47.4% (91) for not 
discontinued pupils. Changes in NCE scores for Reading Comprehension for the 282 grade 2 evaluation 
sample pupils showed that 183 pupils (64.9%) had an NCE gain of 2.0 or more and that 1 75 pupils (62.1%) 
had an NCE gain of 3.0 or more. Discontinued pupils showed greater improvement than did not 
discontinued pupils, with 68.4% (54) gaining more than 3.0 NCEs, conpared to 59.6% (121) for not 
discontinued pupils. 

Program teachers' judgments of individual pupil progress were collected from teachers via the Pupil 
Data Sheet (see Appendix G, pp. 33-34) at the end of the school year. Teachers rated individual pupil 
progress as muctL some, or nona. Of the 2280 pupils served in the program, teacher judgments indicated 
that 2144 pupils (94.0%) showed improvement. More specifically, 998 pupils (43.8%) showed much 
improvement; 1146 pupils (50.3%) showed some improvement; and 136 pupils (6.07o) were judged as 
making no improvement. It should be remembered that these frequencies and percents are based on all 
pupils served, not just pupils included in the treatment group and evaluation samples. 

Parent Involvement Infomiation 

Records of parent contacts and activities were maintained by program teachers using the Parent 
Involvement Log (Appendix D., p. 28), documenting the date of parent contact, the type of activity, and 
which parents or guardians participated in each activity. Table 8 displays parent involvement data 
collected by program teachers on the Parent InvoVement Log for each of the 2280 pupils served in the 
program. The data indicate that a total of 1956 different parents or guardians were involved in some way 
with the program and that program teachers made 3804 contacts with these 1956 individuals. It should be 
noted that the total numbgr of parents involved is not additive, as a parent could be involved in more than 
one activity for the year. Approximately three-fourths (74.7%) of contacts with parents or guardians was 
through individual parent conferences (2840 contacts). The smallest nuntier of contacts with parents or 
guardians involved planning, operating, and/or evaluating the program, with 35 contacts (0.9% of all 
contacts made). Table 8 also displays parent involvement data for the parents of the 1547 treatment group 
pupils. The 1547 treatment group pupils represented 67.9% of the 2280 pupils served, but represented 
81 .2% (3088) of the total number of contacts made for the year and 77.6% (1518) of the individual parents 
involved in the program. Similar to parent involvement for all pupils sen/ed, approximately three-fourths 
(73.9%)) of the parent contacts for treatment group pupils was with individual conferences (2281 contacts). 
The smallest number of contacts with parents or guardians of treatment group pupils also involved 
planning, operating, and/or evaluating the program, with 28 contacts (0.9% of all contacts made). 
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Tables 



Number of Parents 
Reported for Parent Invofvenwnt Activities for 
Early Literacy Program 
1993-94 



Totals for Year 



Treatment Ail Pupils 

Program Activities Group Pupils* Served 
(N=1547) (N=2280) 



1. 


Parents involved in the planning, operation 
and/or evaluation of your unit 

Number of Parents 

Number of Contacts 


26 


31 
oo 


2. 


Group meetings for parents 
Number of Parents 
Number of Contacts 


362 
421 


426 
496 


3. 


Individual parent conferences 
Number of Parents 
Number of Contacts 


1379 
2281 


1786 
2840 


4. 


Parental classroom visits or field trips 
Number of Parents 
Number of Contacts 


228 
289 


275 
356 


5. 


Visits by teacher to parents' homes 
Number of Parents 
Number of Contacts 


59 
69 


67 
77 




Total Parents Contacted^ 
Total Number of Contacts 


1518 
3088 


1956 
3804 



3 Treatment Group Pupils are those who attended the program at least 50 percent of the 
instructional period or who were discontinued from the program. 

^ Total Parents Contacted is based on an unduplicated count of parents contacted, which is less 
than the sum obtained when combining the Number of Parents for Activities 1-5. 
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Program teachefs also maintained records, using the Parent InvoJvement Log, o< whether or not 
parents helped their chfld wKh homework and whether or not the parents read to their child or the child read 
to the parents. Of the 2280 pupils served, 82.8% (1887) had parents wtx) helped with homework and 
87.4% (1 993) either read to their parents or had their parents read to them For the 1 547 treatment group 
pupils. 87.3% (1351) had parents who helped with homework and 91.5% (1415) either read to their parents 
or had their parents read to them. 



Summary/Recommendations 

The Early Literacy program provided additional reading instmction to underachieving first- and second- 
grade pupils in 56 schools. The program featured small group instmction for five or six pupils for 40-45 
minutes daily. For evaluation purposes, the program began on September 20, 1993. For evaluation based 
on standardized test data, the time interval ended March 18, 1994. This provided a maximum of 105 
possible days of instruction. An additional 29 scheduled days (through fvlay 6, 1994) were included in the 
time interval for evaluation of desired outcomes, providing a maximum of 134 possible days of instaiction. 
To meet the attendance criterion (50%) for inclusion in the analyses of standardized test data, grade 2 
pupils must have attended at least 52.5 days. To meet the attendance criterion for inclusion in the 
analyses of Desired Outcomes 1 , 2 and 3. pupils must have attended at least 67.0 days. 

A total of 2280 pupils were served, including 1796 grade 1 and 484 grade 2 pupils. Average daily 
membership for the program was 1 451 .07 pupils, with average days scheduled being 85.28 days per pupil 
and average days served being 74.75 days per pupil. For evaluation purposes, the 2280 pupils served 
were classified as either discontinued (455), not discontinued but attended the program 50 percent of the 
treatment period (1092), or other pupils served (733). The treatment group for Desired Outcome 1 
consisted of the 1 547 pupils (67.9% of those served) who were successfully discontinued from the program 
or who attended the program at least 50 percent of the treatment period, including 1 195 (66.5%) grade 1 
pupils and 352 (72.7%) grade 2 pupils. The treatment group for Desired Outcome 2 consisted of the 1506 
pupils who were either successfully discontinued from the program or who attended the program at least 50 
percent of the treatment period and had available promotion-retention data, including 1 163 (64.8%) grade 1 
pupils and 343 (70.9%) grade 2 pupils. The treatment group for Desired Outcome 3 consisted of 1443 
pupils, including 1195 (66.5%) grade 1 pupils who were either discontinued from the program or who 
attended the program at least 50 percent of the treatment period and the 248 (51 .2%) grade 2 pupils who 
were not discontinued from the program and who attended the program at least 50 percent of the treatment 
period. The evaluation sample for analyses of standardized test data consisted of the 266 grade 2 pupils 
who were successfully discontinued from the program or who attended the program at least 50 percent of 
the treatment period, were English-speaking, and had valid pre- and posttest scores on the MAT6 in Total 
Reading, in addition, 282 grade 2 pupils were successfully discontinued from the program or attended the 
program at least 50 percent of the treatment period, were English-speaking, and had valid pre- and posttest 
scores in Reading Ck)mprehension, comprising the Reading Comprehension evaluation sarrple for grade 2. 

Three desired outcomes were established and met for the Early Literacy program. Desired Outcome 1 
stated that at least 50 percent of the pupils who attended the program at least 50 percent of the treatment 
period or who were discontinued woukJ display over time each of three strategic processing behaviors, 
including monitoring reading, constmcting meaning, and integrating sources of infonnation. Of the 1547 
treatment group pupils, 1117 (72.2%) displayed the three behaviors, indicating the desired outcome was 
met. These 1117 pupils included 828 (69.3%) grade 1 pupils and 289 (82.1%) grade 2 pupils. 

Desired Outcome 2 stated that at least 50 percent of the pupils who attended the program at least 50 
percent of the treatment period or who were discontinued woukJ be promoted to the next grade level. Of 
the 1506 pupils who met the attendance criteria or wore discontinued and were in the district corr^xjter 
retention file, 1366, (90.7%) were promoted, indicating the desired outcome was met. By grade level, 1051 
(90.4%) grade 1 pupils were promoted to grade 2 and 315 (91 .8%) grade 2 pupils were promoted to grade 
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Desired Outcome 3 for grade 1 stated that at least 50 percent of the pupils who wore discontinued or 
atterxJed the program at least 50 percent of the treatment period would read at least five books at text 
reading level 8 or above Of the 1 195 grade 1 pupils who met the attendance criteria or were discontinued. 
81 0 (67.8%) read five or more books at level 8 or above, indicating the desired outcome was met. Desired 
Outcome 3 for grade 2 stated that at least 50 percent of the pupils who attended the program at least 50 
percent of the treatment period and were not discontinued would independently read a minimum of ten 
books. Of the 248 pupils who met both of the criteria. 201 (81 .0%) independently read at least 10 books, 
indicating the desired outcome was met. 

The average NCE gain in Total Reading for grade 2 Eariy Literacy pupils (266) was 3.22 NCEs, with 
discontinued pupils (74) having an average gain of 8.34 NCEs and not discontinued pupils (192) having an 
average gain of 1.25 NCEs. In grade 2 Reading Comprehension, the average NCE gain for the 282 
evaluation sample pupils was 7.51 NCEs. with discontinued pupils (79) showing an average gain of 1 1.46 
NCEs and not discontinued pupils (203) having an average gain of 5.98 NCEs. 

• Changes in NCE scores for Total Reading for the 266 grade 2 evaluation sample pupils indicated that 
146 pupils (54.9%) had an NCE gain of 2.0 or more and that 139 pupils (52.3%) had an NCE gain of 3.0 or 
more. Discontinued pupils showed greater improvement than did not discontinued pupils, with 64.9% (48) 
gaining more than 3.0 NCEs. compared to 47.4% (91) for not discontinued pupils. Changes in NCE scores 
for Reading Comprehension for the 282 grade 2 evaluation sample pupils showed that 183 pupils (64.9%) 
had an NCE gain of 2.0 or more and that 175 pupils (62.1%) had an NCE gain of 3.0 or more. 
Discontinued pupils showed greater improvement than did not discontinued pupils, with 68.4% (54) gaining 
more than 3.0 NCEs. conpared to 59.6% (121) for not discontinued pupils. 

Records of parent contacts and activities maintained by program teacher for the 2280 pupils served 
indicated 1956 different parents or guardians were involved in some way with the program. These 1956 
individuals made a total of 3804 contacts with program teachers. The 1547 treatment group pupils 
represented 67.9% of the 2280 pupils served, but represented 81 .2% (3088) of the total number of contacts 
and 77.6% (1518) of the individual parents involved in the program. 

Based on the evaluation results, it is recommended that the Eariy Literacy program be continued in the 
1994-95 school year. With that in mind, the following recommendations are presented. 

1 . The process by which pupils are discontinued from the program needs to be re-examined. 
Pupils are to be discontinued from the program when they reach the average reading ability of 
their classroom. Often times program teachers keep pupils in the program too tong after they 
have reached the average level of ability for their classroom. If pupils are kept too long in the 
program, other pupils may be denied service. 

2. As increased parent involvement is regarded as one of the indicators of effective schools, every 
effort must be undertaken to promote parental involvement in the program, especially in the 
areas of planning, operation, and evaluation. 

3. The whole language instmctional strategies and techniques used by program teachers need to 
be shared with and enhanced by the regular classroom teacher. The instmction provided by the 
program teacher and by the regular classroom teacher must conx)lement each other. The 
academic achievement of pupils will suffer if they receive mixed messages in their reading and 
writing instmction. Opportunities must be made available for program teachers and regular 
classroom teachers to devetop a consistent whole language based approach to instmction. 

4. An on-going process of site visitations by the program evaluator needs to be continued. These 
visits provide invaluable infomnation for the program evaluator in the areas of content and 
instruction and provide program teachers the opportunity to clarify questions they may have 
about evaluation requirements and record keeping. These visitations also help buikJ a rapport 
between the program teacher and program evaluator. 
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5. Inservice meetings should be continued to provide program teachers the opportunity to enhance 
their instructional intervention skills, to share instructional ideas with one another, and to clarify 
any concerns or misconceptions they may have about the total Early Literacy program. 
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CONCEPTS ABOUT PRI^4T SCORING SHEET 



Date: 



Stones: 



School Name: 



Classroom Teacher 



Sand: 



TEST SCORE 
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Use the script when administering this test. 



PAGE 



Cover 



2/3 



4/5 



8/9 



10/11 



12/13 



14/15 



16/17 



18/19 
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SCORE 



ITEM 



1. Front of lxx)k 



2. Print contains message 



3. Where to start 

4. Which way to go 

5. Return sweep to left 

6. Word by word matching 



7. Rrst and last concept 



8. Bottom of picture 



9. Begin The* (Sand) or T (Stones) 
bottom line, top OR tum book 



10. Line order altered 



1 1 . Left page before right 

12. One change in word order 

13. One change in letter order 



1 4. One change in letter order 

15. Meaning of? 



1 6. Meaning of period/full stop 

1 7. Meaning of comma 

18. Meaning of quotation mart^ 

1 9. Locate M m H h (Sand) OR 
Tt Bb (Stones) 



20. Reversible words (was, no) 



21 . One letter two letters 

22. One woid: two words 

23. Rrst & last letter of word 

24. Capital letter 



Directions 

1 . Place the pupil's ID label on the back of the form. 
If there is no ID label for a pupil, please provide 
student number, birthdate. student's legal name 
(last, first. Ml), grade, and school code in the 
space provided. 

2. Put an X in the blank next to the fonrn of the test 
the student took (either Stones or Sand). 

3. In the score column, place a 1 (one) beside each 
con-ect item. If the item was incorrect, place a 0 
(zero) in the column. 

4. Record the total number of items conrect in the 
test score box. 

5. Turn this form over and enter data from the 
Dictation test. 
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Date: 



DICTATION INDIVIDUAL SCORING SHEET 
TEST SCORE 



School Name: 



Classroom Teacher: 
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Th e bus is 
1 2 3 4 5 6 7 



com i n g. 
8 9 1 111 
0 12 3 



it will 
11 111 
4 5 6 7 8 



stop 
12 2 2 
9 0 12 



here 

2 2 2 

3 4 5 



to let me 
2 2 2 2 3 3 3 
6 7 8 9 0 1 2 



get on. 
3 3 3 3 3 
3 4 5 6 7 



Directions 

1 . Be certain you have completed the required infomiation at the bottom of the form or placed an ID label on the form. 

2. Follow the directions for administering and scoring the Dictation test. 

3. Iri the blank above each phoneme, place a 1 (one) if the pupil responded correctly. If the phoneme was incorrect 
place a 0 (zero) in the blank. If the phoneme was not attempted, do not mark anything on the !:.ie. 

4. Record the total number of correct phonemes in the test score box. 

^' in youl fiIeV°"^ *° ^^^^"^ evaluator at the Department of Program Evaluation. 52 Starling Street. Keep a copy 



PLACE LABEL HERE 



NAME 

STUDENT NO. _ 
SCHOOL CODE. 



LAST 



FIRST 
BERTHDATE 



MI 



M M D D Y Y 



GRADE 
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Scx:ial Security Number 



Name 



(Legal Name for Mailing Labels) 
SchcxDl Assignment . 



Your Program Coordinator/Teacher Leader. 



Cost Center 



List all Chapter 1/DPPF programs you are involved with: 
Pro gram 



1. 

2. 
3. 
4. 



Ppogram Code 



Full-Time Employee 

or (check one) 
Part-Time Employee 



Number of Reading Recovery sections per day 
Number of Early Literacy -Gr. 1 groups per day 
Number of Early Literacy -Gr. 2 groups per day 
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Program Code Last (Name of Pupil) Rrst Grade 



Parent/Guardian Address Zip Phone Number 

THE COLLECTION OF PARENT INVOLVEMENT DATA IS REQUIRED BY CHAPTER 1. 

Please check if the following two activities occurred for this pupil anytime this year. 



B 



Parent helped child with homework 
Parent read to chiW or chiW read to parent 



DIRECTIONS: Please indicate in the fields below the date, activity, and name of parent/guardian. 
Obviously, you may keep expanded notes about activities somewhere else. 

Dale. Activity* Attendeefe^ 

MMDDYY (1-5) Parent/Guaixiian 



*Kinds of Parent Involvement to record for the column labeled Activity 

(1 ) Involved in planning (do not include advisory council) 

(2) Group meetings (do not include advisory council) 

(3) Individual conferences (telephone conferences included) 

(4) Parental classroom visits 

(5) Home visits 
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"Evidence of Strategic Processing" 

1993-94 
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Student Legal Namd 



Student Birthdate 
Student Numt>er 



Last, 



Rrst 



M M 0 0 



Grade 



Program Teacher ^4ame . 

Program Code 

School 



RATIONALE 
AND 

PROCEDURE: 



One of the benchmarks for detenmining whether or not a student is deemed 
successful as a reader is if the student exhibits behaviors which display strategic 
processing over a period of time. Three of these behavfors are listed below. The 
student should be observed over a period of time (the full school year) and will 
have met this desired outcome if he/she appropriately exhibits each behavior at 
least once during the observational periods. The program teacher should 
observe these behaviors multiple times during the treatment period and record 
the behaviors, when observed, on the form below. 



DIRECTIONS: 



CHECKLIST 

Place a "X" (check) in the appropriate space when the behavior is consistently 
observed. 



OUTCOME INDICATORS 



OBSERVATIONAL PERIODS 



Behaviors 

1 . Constructs Meaning 

2. Monitors Reading 

3. Integrates Sources of Information 



Sep./N0V, DecTPfth Apr/May 



Please share this with the classroom teacher during your conference time. Do not 
send a copy of this form to the new school when a student transfers to ar,other 
school. You will need this information to complete each pupil's PDS in the 
Spring Also, please send a copy of this form to your coordinator at the end of 
the year 
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Columbus Public Schools 
Compensatory Education Programs 



Marcn 23. 1994 
10:04 



SHEET 
8 158 



SCHOOL CODE 



PUPIL DATA SHEET 
PRCGPAM CODE 9 4 3 9 6 SSN 



SCHOOL NAME 
1 . STUDENT NAME 



PROGRAM NAME 



TEACHER NAME 



last 

STUDENT NO. GRADE BIRTHDATE 

+ - 

AVERAGE -CURS PER WEEK OF INSTRUCTION I 



* 1 rst 

/ / 



PUPIL PROGRESS 

IS THIS PUPIL ENGLISH SPEAKING? 

WAS This pupil discontinued? 

(CAREFULLr- READ GUIDELINES) 

7. WAS THIS Pupil previously served in 

READING RECOVERY THIS SCHOOL YEAR? 

8. PARENT HELPED WITH HOMEWORK? 

9. PARENT READS TO CHILD OR CHILD READS 
TO PARENT? 



NONE 

NO 

NO 

NO 

NO 
NO 



- ♦ . + + 

SOME 
YES 
YES 

YES 

YES 
YES 



MUCH 



FOR NUMBERS 10-14, FILL IN THE NUMBER OF THIS ?UPIL S PARENTS INVOLVED 
IN EACH ACTIVITY DURING THE YEAR AND TOTAL NUMBER OF CONTACTS. 



NO. OF PARENTS 



TOTAL NO. OF CONTACTS 



10. 



PLANNING 



GROUP MEETINGS 



12. INDIVIDUAL CONFERENCES 



13 



Id . 



CLASSROOM VISITS 



HOME VISITS 



+ + 

+ + 



15. NUMBER CF DAYS SERVICE SCHEDULED 
(CAREFULLY READ INSTRUCTIONS) 



THRU C5-06-94 



THRU 05-06-94 



16 NUMBER C' DAYS SERVICE RECEIVED I I I 
(CAREFULLY READ INSTRUCTIONS) | | | 

4- ■ 

17 WHILE IN vOUR CLASS, the Number of Boous tjead at 
Text Reading Lev/el Greater than 7 
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BEST COPY AVAILABLE 



( OVER ) 



ColumDus PuDlic Schools 
Compensatory Education Programs 



March 23. 1994 
10:04 



Sheet pupil data sheet 

8 15 program code 9 4 3 9 6 



S'^uDENT NAME ] _ / 

last ~~ ~~ ^^-g- 



STUDENT NO GRADE BIRTHOATE / 



INDICATt THE STRATEGIC PROCESSING BEHAVIORS DISPLACED 8 >- PUPIL 

18. CONSTRUCTS MEANING NO YES 

19. MONITORS READING NO YES 

20. INTEGRATES INFORMATION SOURCES NO YES 
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